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Abstract 

We give optimal convergence rates in the central limit theorem for 
a large class of martingale difference sequences with bounded third 
moments. The rates depend on the behaviour of the conditional vari- 
ances and for stationary sequences the rate n~^/^logn is reached. We 
give interesting examples of martingales with unbounded increments 
which belong to the considered class. 
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1 Introduction and notations 



The optimal rate of convergence in the central limit theorem for independent 
random variables (Xj)jgz is well known to be of order n~^/^ as soon as the Xj's 
are centered and have uniformly bounded third moments (cf. Berry ^ and 
Esseen [H]). For dependent random variables the rate of convergence was also 
most fully investigated but in many results the rate is not better than n~^^^. 
For example, Philipp obtains a rate of n~^/^(logn)'^ for uniformly mixing 
sequences, Landers and Rogge [Tl| obtain a rate of n~^/'^(logn)^/'^ for a class 
of Markov chains and Sunklodas [20] obtains a rate of n~^/^\ogn for strong 
mixing sequences. However, Rio [J^J has shown that the rate n~^/^ is reached 
for uniformly mixing sequences of bounded random variables as soon as the 
sequence (0p)p>o of uniform mixing coefficients satisfies ^p>o^"^p ^ 
|12| established also a rate of convergence in the central limit theorem 

for bounded processes taking values in R'^ under some mixing conditions and 
recently, using a modification of the proof in Rio [12], Le Borgne and Pene 
[T5] obtained the rate for stationary processes satisfying a strong decor- 
relation hypothesis. For bounded martingale difference sequences, Ibragimov 
[TT] has obtained the rate oin~^^^ for some stopping partial sums and Ouchti 
[T7] has extended Ibragimov's result to a class of martingales which is related 
to the one we are going to consider in this paper. Several results in the rate 
of convergence for the martingale central limit theorem have been obtained 
for the whole partial sums, one can refer to Hall and Heyde [10] (section 
3.6.), Chow and Teicher (Theorem 9.3.2), Kato [IH], Bolthausen [2] and 
others. In fact, Kato ^| obtains for uniformly bounded variables the rate 
n~^/^(logn)^ under the strong assumption that the conditional variances are 
almost surely constant. In this paper, we are most interested in results by 
Bolthausen [2] who obtained the better (in fact optimal) rate n"^/^ logn un- 
der somewhat weakened conditions. In this paper, we shall not pursue to 
improve the rate logn but rather introduce a large class of martingales 
which leads to it. Finally, note that El Machkouri and Volny have shown 
that the rate of convergence in the central limit theorem can be arbitrary 
slow for stationary sequences of bounded (strong mixing) martingale differ- 
ence random variables. 

Let n > 1 be a fixed integer. We consider a finite sequence X = (Xi, ...,X„) 
of martingale difference random variables ( i.e. Xk is JF^,-measurable and 
E{Xk\J-'k_i) = a.s. where {J^k)o<k<n is an increasing filtration and J-q 
is the trivial a-algebra). In the sequel, we are going to use the following 
notations 

al{X) = E{Xl\T,.,), rl{X) = E{Xl), l<k<n, 
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vl{X) = Y,rl{X) and V^{X) = ——Y,^l{X). 

k=l ^n{^) 1^^-^ 

We denote also S'„(X) = Xi + X2 + ... + X^. The central limit theorem 
established by Brown |4j and Dvoretzky states that under some Lindeberg 
type condition 

A„(X) = sup L {Sn{X)/Vn{X) <t)- ^t) I . 0. 

For more about central limit theorems for martingale difference sequences 
one can refer to Hall and Heyde [HI]. The rate of convergence of A„(X) to 
zero was most fully investigated. Here, we focus on the following result by 
Bolthausen |2|. 

Theorem (Bolthausen, 82) Let 7 > 6e fixed. There exists a constant 
L(7) > depending only on 7 such that for all finite martingale difference 
sequence X = (Xi, ...,X„) satisfying Vj^{X) = 1 a.s. and ||Xj||oo < 7 then 

We are going to show that the method used by Bolthausen [2J in the proof 
of the theorem above can be extended to a large class of unbounded martin- 
gale difference sequences. Note that Bolthausen has already given extensions 
to unbounded martingale difference sequences which conditional variances 
become asymptotically nonrandom (cf. [2], Theorems 3 and 4) but his as- 
sumptions cannot be compared directly with ours (cf. condition (jTJ below). 
So the results are complementary. 

2 Main Results 

We introduce the following class of martingale difference sequences: a se- 
quence X = {Xi, Xn) belongs to the class Ainij) if X is a martingale 
difference sequence with respect to some increasing filtration {J^k)o<k<n such 
that for any 1 < k < 

E(|Xfc|3|^,_i) <7fc^(X2|^A-i) a.s. (1) 
where 7 = (7^)^ is a sequence of real numbers. 

Our first result is the following. 
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Theorem 1 Let ^ he a sequence of real numbers. There exists a constant 
L(7) > (not depending on n) such that for all finite martingale differ- 
ence sequence X = (Xi, ...,X„) which belongs to the class J^n{l) and which 
satisfies V^{X) = 1 a.s. then 

A„(A-) < m (^) 

where Un = V^^^7fc. 

Remark 1 Note that if the martingale difference sequence X is stationary 
then we obtain the rate n~^/^logn which is optimal (cf. Bolthausen [2]). 

As in Bolthausen 0, we derive the following result when the restrictive 
condition V^{X) = 1 a.s. is relaxed. 

Theorem 2 Let 'y be a sequence of real numbers. There exists a constant 
L(7) > (not depending on n) such that for all finite martingale difference 
sequence X = (Xi, ...,X„) which belongs to the class Ain{l) then 

A„(X) < L(7) (^^^ + mX) - A WV^iX) - l||f ) 

where Un is defined in Theorem^ 

Examples. Let X = (Xi,..,X„) be a sequence of martingale difference 
random variables such that sup]^<j<„ ||Xj||oo < M < oo and consider an ar- 
bitrary sequence of independent random variables (ei, with zero mean 
and finite third moments which are also independent of X . One can notice 
that the sequence Y = (Yi, F„) defined by = X^ + Ek (resp. Y^ = Xi^Sk) 
belongs to the class A4n{l) where 

Moreover if V^{X) = 1 a.s. (resp. V^{X) = 1 a.s. and {ek)k is stationary) 
then V^{Y) = 1 a.s. 

In the sequel, we are going to use the following lemma by Bolthausen j2j. 

Lemma 1 (Bolthausen, 82) Let k >0 and / : M — >• M &e a function which 
has k derivatives f^^\ •■■,/^^^ which together with f belong to L^^ji). Assume 
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that f^''^ is of bounded variation \\f^^^\v, if X is a random variable and if 
ai 7^ and 02 are two real numbers then 

\Ef^'\a^X+a2)\ < \\f^'^\\vsnp\fi{X < + sup 

where 0(x) = (27r)"^/^ exp(— 

For any random variable Z we denote = sup^gig \\iiZ < t) — $(t)|. We 
need also the following extension of Lemma 1 in Bolthausen which is of 
particular interest. 

Lemma 2 Let X and Y be two real random variables. If there exist real 
numbers k > and r > 1 such that Y belongs to L^^{fi) then there exist 
positive constants ci and C2 such that 
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6{X + Y)< 26{X) + ci \\E (|rhX) ||,"+^ A \\E {Y^\X) (2) 

and 

S{X) < 2S{X + Y) + C2 \\E (IF^X) ||?^ A \\E {Y^\X) (3) 

The proofs of various central limit theorems for stationary sequences of ran- 
dom variables are based on approximating the partial sums of the process 
by martingales (see Gordin [H], Volny [2I|)- More precisely, if (/ oT'')k is a 
p-integrable stationary process where T : f2 — >^ f2 is a bijective, bimeasurable 
and measure-preserving transformation (in fact, each stationary process has 
such representation) then there exists necessary and sufficient conditions (cf. 
Volny [21]) for / to be equal to m + g — goT where {moT^)f. is a p-integrable 
stationary martingale difference sequence and g is a p-integrable function. In 
fact, such a decomposition can hold also with m and g in some Orlicz space 
(see [22]). The term g — g oT is called a coboundary. 

The following theorem gives the rate of convergence in the central limit theo- 
rem for stationary processes obtained from a martingale difference sequence 
which is perturbed by a coboundary. 

Theorem 3 Let p > be fixed and let (/ o T'')^ be a stationary process. If 
there exist m and g in L^{n) such that (m o T^)^ is a martingale difference 
sequence and f = m + g — goT then there exists a positive constant c such 
that 

A„(/) < 2A„,(m) + -^j^. 

If p = 00 then 

2c||5'||oo 



A„(/) < 2A„(m) + 



n 



1/2 
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Recently, Bosq has shown that the condition J2j>o3\^3\ < oo is sufficient 
to obtain the optimal rate n~^/^ for the linear process = J2j>o ^k-j^j 
when {ej)j is a i.i.d. sequence with finite third moment (Bosq established 
this result in the more general setting of Hilbert spaces). We are going to 
give a convergence rate result for linear processes when the {ej)j are not 
independent. By 

Xk = ^ak-jej, k>l, (4) 

we denote a stationary linear process, {Bj)j is a stationary martingale differ- 
ence sequence and {aj)j are real numbers with Ylj^z'^'j < 

Corollary 1 Let be a sequence of real numbers. Consider the linear process 
(Xfc)fc defined by @ where {Sj)j is a stationary martingale difference sequence 
such that EIeqI^ < oo for some p > 3. Assume that e = (^i, ...,£„) belongs 
to the class Ainij) and V^{e) = 1 a.s. If 



oo f 




P 










+ 




\ <oo (5) 


k=l K 











then there exists a constant L{^) > (not depending on n) such that 
If moreover Ef) is a.s. bounded then 

A„(x) < m (!^) . 

Remark 2 One can see that the condition X]jezbM%l < oo is more re- 
strictive than (ISj). 

Remark 3 Using Theorem [2l one can obtain a convergence rate result for 
the linear process (Xfc)^ when the condition V^{e) = 1 a.s. is relaxed. 

3 Proofs 

Proof of Theorem\^ Consider u = («„)„ defined by m„ = V^^^7fc. Clearly 
the class J^n{l) is contained in the class 7V1„(m). For any {u,v) e M^* x M^, 
we consider the subclass 

Cn{u,v) = {Xe Mn{u) I V^{X) = 1, v„iX) = V a.s.} 
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and we denote 

Pn{u, V) = sup {A„(X) I X e Cn{u, v)} . 

In the sequel, we assume that X = (Xi,...,X„) belongs to Cn{u,v), hence 
X = (Xi, Xn-2, Xn-i + Xn) belougs to £„_i(4'u,f) and consequently, 

Let Zi, Z2, Zn be independent identically distributed standard normal 
variables independent of the cx-algebra J-'n (which contains the a-algebra 
generated by and ^ be an extra centered normal variable with 

variance > 1 V which is independent of anything else. Noting that 
'^^^iO'i{X)Zi/v is a standard normal random variable and according to In- 
equality in Lemma [21 

nn 

A„(X) <2sup|r„(t)| + — . (6) 

tern ' V 

where 

Tn{t) = /i {{Sn{X) +0/v<t)-^^\^\^^ a,{X)Z, + i]/v<t 

For any integer 1 < /c < n, we consider the following random variables 

fc-i 

A i 



i=l \i=k+l 

^( E ^'W + n and T,{t) 



Hk = -\ > ofiX) + 6' 1 and T,(t) ^ — t e R 

with the usual convention Yl^=n+i'^ii-^) ~ Yl^=n+i'^ii-^)^i ~ More- 
over, one can notice that conditionned on Qk = <7{Xi, Xn, Zk), the ran- 
dom variable Wk is centered normal with variance H^. According to the well 
known Lindeberg's decomposition (cf. [E]), we have 

k=l ^ / V 



< t 



E/^ f- < Tkit) - ^ V f- < Tkit) - '-^] 
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Now, for any integer 1 < k < n and any random variable (k, there exists a 
random variable \ek\ < 1 a.s. such that 

$ {n{t) - a) = ^ iTk{t))-Ck^' (nit) - £,a) a.s. 

So, we derive 



Since V^(-^) = 1 a.s. we derive that and rfe(t) are J^-.i-measurable, 
hence 



k=l V K \ 



, al{X)Zl 



vHk 



HI 



vHk 



and consequently 



|rnW|<^(5l + 52) 



where 



and 



A:=l ^ 



k=l 



HI 



^kXk 

vHk 

^'k^k{X)Zk 

vHu 



(7) 



Consider the stopping times z^(i)j=o,..,n defined by i/(0) = 0, v{n) = n and 
for any I < j < n 



1=1 



Noting that {1, ...,n} = U"^j^{i/(j — 1) + 1, a.s. we derive 



j=l ^ k=u(j-l)+l 



Hi 



^kXk 

vHk 



8 



moreover, for any ^{j — 1) < k < we have 



Similarly, 



=1 i=l 

A 2 

= rrij a.s. 



^i=i^O-i)+i 



i=l i=l 

2 



1 / 2 (j - 1)^2 ^ 

\ n 



^M] a.s. 



Now, for any v{j — 1) < /c < I'^j) put 



i=i/(j-i)+i 



"3 ^^"J 



and for any positive integer q consider the real function -0^ defined for any 
real x by il^q{x) = sup{|$"'(y)| ; y > ^ — In the other hand, on the set 
n {l-'^fcl < q\ we have 

\Tkit) - 



£kXk 1 




t - 




-i)+i 


Rk ^k^k 1 


vHk 






Hk 




Hk vHk ' 




> 


\t- 




■i)+i| 


\Rk\ \Xk\ 












Hk vHk 




> 


\t- 


y^^i3- 


-i)+i| 


\Rk\ q 












rrij 9 




> 


\t- 


2Mj 


-i)+i| 


— q a.s. (since ^ > 1) 
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Thus 



T,{t) - 



vHk 

So, for any 1 < j < n we have 



\Xk 



k=uij-l)+l 



Hi 



vHk 



'^Akn{\Xk\<q} 



1 



Akn\Xk\<q- 



Mi 



Hi 



\^y{j-l) 



k=v(j-l)+l 
k=u(j-l)+l 

k=uU-l)+l 



t-Y,, 



^q 

\^k-l ) \^u{j-l) 
i^q 



v(j-l) + l 



i'q 



t-Y,, 



M, 



Moreover, note that 



E ^^w = E^^w- E 

A:=J.0-1)+1 



k=l 



k=l 



^ (j + ly (j - _ 2v' 

^ — a.s. 

n n n 

Using Lemma d noting that ||V^g||oo < 1 and keeping in mind the notation 
5{Z) = sup^gjj ^ ^) ~ '^(^)l there exists a positive constant C3 such that 



t-Y, 



M. 



Now, using Lemma [2I and the inequality 



E 



.k=u{j~l)+l 



J -I 



n 



a.s. 
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we obtain 
•5(no-i)+i)<2^(S„(A')/tO+ci 



4;!. t 



Y,. 



2A„(X) + ci 



E 



\k=u{j-l)+l / 



1/2 



1/2 



Y, 



and so 



<2/3„_i(4m,w) + ci 1- 



Mj J 



J-1 



n 



1/2 



<2/3„_i(4«,^;) + ci 1- 



J-1 



1/2 



Using this estimate and the dominated convergence theorem, we derive for 
any integer 1 < j <n, 



Hi 



CaUu V 



<^x-x /3„_i(4x.,^)+ 1 



n 



vHk 



J-1 



n 



1a, 



1/2 



In the other hand, for any integer — I) < k < z/(j) 

l-^il ^ 1^ ~ '^i'(j-l)+l| 



max 



_i/(i-i)<i<i/0-) m^- 
Since the set Ak is V Jv(j-i), we have 



> 



2Mi 



[•k-k] 



^1 



fe=;/0-l)+l 

E 



vHk 



k=u{j-l)+l ^ 



k=v{j-l)+\ ^ 



fc = Z.(j-l) + l 



//2 
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Since 



we derive 



fc=z.{i-l)+l 



2u f ^ 



< — 3- X — X /i ( max > 



mj n \v{j-'\-)<i<u{j) 2Mj 

— xE (min |l, "^^^ r^E ( max \R,\^\J^,^j^i)] ]] 

- X E mill a, r^E 



< ^ X — X I /3„_i(4m, w) + (^1 - ^^^^J + I (using Lemma d). 

Thus there exists a positive constant C5 such that 

2 / / ■ _ 1 \ 

Finally, we obtain the following estimate 



^1 



n , 
A:=l 

( ^ , ,^1 A 1 / j-n'/' Am. 

< CsMn X — X 4M,t; V — + V — U - + V ^ 

\ i=i ■> i=i ^ j=i 



< C^Un X — X l3n-l{^U,v) : + Tllogn 



n 



- 



Note that to obtain the above estimates of 5*1, we have only use the fact that 
the martingale difference sequence X belongs to the class Cn{u,v). Since 
the sequence aZ ^ (cri(X)Zi, (T,i(X)Z„) belongs to £„(4M/v^27r, f ) (with 
respect to the filtration JF^ = (t(Xi, Zi, Zk)), we are able to reach 
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a similar estimate for S^- 

5*2 < cqUu X — X Pn-i{lGu/V2Tr,v)—7= +n\ogn 



where cq is a positive constant. Using ^ and there exist a positive 
constant c such that 



. f3n-iilQu/V2TT,v) \ogn\ 39 

PJU,V) < CUn , + 



V 



Putting 

A 



Dn = sup <; ' ; / ; ueWl,v>Q 



Un log n 

and 6"^ = {2 + 4c^) m^, we derive 



< ^ + C 

where C is a positive constant which does not depend on n. Finally, we 
conclude that 

lim sup Dn < 2C. 
The proof of Theorem Q] is complete. 

Proof of Theorem{B Let X = in A^„(m). Following an idea 

by Bolthausen, we are going to define a new martingale difference sequence 
X which satisfies V^{X) = 1 a.s. Denote di = — v'^\\i and 

doo = ll^nKi (^) ~ ^nlloo- The letter d will denote either di or doo. Con- 
sider the random variables Xn+i, Xn+[2d/ul]+i defined as follows: Let k = 
[{v^ + d — v'^V^)/u'^], conditioned on J^n+j-i, we assume 

{± Un w.p. 1/2 for j < k 

±{vl + d-vX-kulY'^ w.p. 1/2 for 3 = k + l 
else 

where [ . ] denotes the integer part function and w.p. is the abbreviation of 
with probability. In the sequel, n, -i)^, and S denote respectively n+[2(i/M^], 
f?(X), Vl{X) and Sn{X). One can easily check that X = (Xi, X^j+i) 
belongs to M.f^{u) and = 1 a.s. We have 

An(X) < sup |/i(^„/{) <t)- ^t)\ + sup 1$ f - 
ieK iGR V / 
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Noting that v"^ — v'^ = d and using Lemma [21 with k = 2 and r = 1, if = di 
there exist a positive constant c such that 

cd^^ f V — V. 



A„(X) < 2 sup \fiiS/v <t)- ^t)\ + — !- + c 
< 2sup|/x(^/{) < t) -^(t)! + ^ 



Similarly \id = d^o then 



2/3 ■ 



cdH^ f V — V„ 



2cd 



A„(X) <2sup|/i(^/{)<t)-<l'(t)| + ^ + c 

< 2snp\n{S/v <t)- ^t)\ 
Finally, applying Theorem ^ we derive 

d[''^ d, 



A„(X) < 2sup < t) -$(t)| +2cmin 



< 2L(u) 2 + 2cmm 



1/3 ^1/2 

oo 

Vn ^ri 





< 2L{u) \^ j + 2cmin <^ \ if n is sufficiently large. 

The proof of Theorem [2l is complete. 

Proof of Lemma\E Let k > and r > 1, denote (3 = \\E \\r and 

consider g e R U {cxo} such that 1/r + 1/q = 1. Let A > and t be two real 
numbers we have 

fiiX + Y <t)> n{X <t - X,Y <t- X) 

= l^{X <t-X)- i2{X <t- X,Y >\t-X\) 
>^i{X <t-X)-E{ lx<t-x i2{\Y\>\t-X\\X)}. 



Since 



E { lx<t-xK\Y\ >\t-X\ \X)} <E{\t- X\-'Ei\Y\'\X) lx<t-x} 

</3\\E{ lx<t-x\t-X\-''}\\, 

< /5A-^ 
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we obtain 

+ Y <t)> ii{X < t - A) - pX-K 

Consequently 

+ Y <t)- ^t) > fi{X < t - A) - $(t - A) - - l3X' 
i/{k+i) 



and taking A = (/?A/27r) , there exists a positive constant c such that 

6{X + Y)>6{X)-c(3'/^''+^\ (9) 

In the other hand 

/i(X + Y <t)< ij{X <t + X)+ i2{X > t + A, |F| > |t - X|) 

= fi{X<t + X) + E{ lx>t+x fi{\Y\>\t-X\\X)} 

and 

E { lx>t+x fi{\Y\<\t-X\\X)}<E{ lx>t+x E{\Y\'' \X) \t - X|-^} 

<(3\\E{lx>t+x\t-X\-''^^ 
< /JA-^ 

Consequently 

/i(X + Y <t)< /i(X < t + A) + /3A-*^ 

and 



+ r < t) - < /i(X < t + A) - $(t + A) + ^ + /5A-^ 

V 27r 



Taking A = (/5v^27r)^/*^''+^\ there exists a positive constant c such that 

5(X + r ) < + c'/3^/(^+^) . (10) 

Combining ((HI) and (fTTH) with Lemma 1 in Bolthausen [2] complete the proof 
of Lemma O 

Proof of Theorem It suffice to apply Inequality ^ of Lemma El with 
k = p, r = 1 and Y = n^^/^ id — 9 ° T'^)- The proof of Theorem El is com- 
plete. 

Proof of Corollary\^ Since {sj)j is stationary, there exists a measure pre- 
serving transformation T such that Sj = £o ° TK By Theorem 2 in [21], the 
condition (jSl) is necessary and sufficient to the existence of a function g in 
LP(/i) such that 

Xq = m + g - g oT 

where m = ^oYlik&^k- Since m satisfies the assumptions of Theorem [U it 
suffice to apply Theorem 01 The proof of Corollary [His complete. 
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